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Abstract 

This paper considers the three-parameter exponentiated Weibull family under type 
II censoring. It first graphically illustrates the shape property of the hazard function. 
Then, it proposes a simple algorithm for computing the maximum likelihood estimator 
and derives the Fisher information matrix. The latter one is represented through a 
single integral in terms of hazard function, hence it solves the problem of computation 
difficulty in constructing inference for the maximum likelihood estimator. Real data 
analysis is conducted to illustrate the effect of censoring rate on the maximum likelihood 
estimation. 
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1 Introduction 



In testing the reliability of a component, n identical components are placed on life-testing. 
The type II censoring scheme is to stop the test procedure when one observes the rth failure, 
r < n. Various models have been proposed for lifetime distribution. Among those lifetime 
distributions, Weibull distribution is the most popular used. Based on Weibull distribution, 
various generalizations have been studied (Pham and Lai, 2007). Among those generaliza- 
tions, one of the families is called exponentiated Weibull distribution (EWD), initially pro- 
posed by Mudholkar and Srivastava (1993). EWD family not only covers the one-parameter 
exponential family, exponentiated exponential family as a sub-family, but also covers the 
most popular used two-parameter Weibull family as a special sub-family. One of the nice 
features of EWD family is that it allows non-monotonic hazard functions, such as unimodal 
shaped and bathtub shaped, appeared in science, engineering and medical fields. For more 
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shapes of hazard functions, see Mudholkar and Srivastava (1993). Mudholkar, Srivastava 
and Preimer (1995) reanalyzed the bus- motor- failure rate data using EWD family. 

Singh, Gupta and Upadhyay (2002, 2005) studied the point estimators of three-parameters 
for EWD under complete data and type II censored using various estimation methods such 
as maximum likelihood method, Bayes method and generalized maximum likelihood method. 
Numerical comparisons were obtained for the point estimators. Ortega, Cancho and Bol- 
farine (2006) gave an influence diagnostics in exponentiated WeibuU with censored data. 
Ortega, ct al. (2006) states that "it is not possible to compute the Fisher information 
matrix...". 

In this paper, we derive a simple expression for the Fisher information matrix through a 
single integral of the hazard function, hence obtain the asymptotic normality of the maximum 
likelihood estimator of the three unknown parameters for EWD under type II censoring. 



2 Shape property of the hazard function 



Assume that all n independent components under testing have cumulative distribution func- 
tion F{x;9)j density function f{x;6) and hazard function h{x;6) with parameter vector 
9 e Q C -R5|_, where is an open set in i?^, — (0, oo). Let 6 = {a,/3,a)'^. Then the 
distribution and density functions are 



and 



F(x;, 



(7 \(7 



/3-1 
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X > 



respectively. Here a and j3 are shape parameters and cr is a scale parameter. Notice that if 
a — 1, it reduces to the two-parameter WeibuU distribution family. If /3 = 1, it reduces to the 
exponentiated exponential family. If a = 1 and ^ = 1, it is the one-parameter exponential 
family. If a = 1 and P — 2, it reduces to Rayleigh distribution and generalized Rayleigh or 
Burr type X distribution ii /3 = 2. 

The hazard function is the ratio of / and 1 — F. It takes various shapes. To be more 
precise, the hazard function of EWD is 



h{x) = 



a0 



1 



exp 



exp 



/3-1 



1-1 -exp -(f) 



(1) 



Mudholkar, Srivastava and Freimer (1995) stated that the monotonicity property of the 
hazard function is completely determined by {a, f3) in the first quadrant. The first quadrant 
is divided into four regions as shown in Figure 1, where the curves arc the boundaries of the 
four regions. That is af3 = 1 and /3 = 1. It is easy to understand that the shape property 
of the hazard function is independent of the scale parameter a. To see this, let X be EWD 
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Figure 1: The graphical display of the four regions which separate the parameter do- 
main for shape properties of the hazard function, where the curve is for a/3 = 1. mono. 
dec=monotonic decreasing, mono. inc.=monotonic increasing. 
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with parameters 9, denoted by X ~ EWD{a,P,(7). Then X/a ~ EWD{a,f3, 1). However 
the shape property with respect to the shape parameters is not easy to see. Mudholkar, 
Srivastava and Preimer (1995) gave the theorem (their Theorem 2.1), but no detail proof. 
We will illustrate the theorem through visuahzing the sign of the derivative of the hazard 
function. For this purpose, we first derive the derivative function of the hazard function, 
then make comments on the sign of the derivative function. 

Proposition 2.1 Let 

s{z) ^/3z\nz [{z -!)"+(«- ^)z°-^] + {/3 - l){z - 1) [z" - {z - 1)"] . 
Then the sign of the derivative of the hazard function h is the same as the function s. 

Proof: Let z = exp ((-^^\ Then 2; > 1, In^; = f-)'^ and x = cr (In ^)^. Rewrite h 



function into a function in z and denote as r{z). We have, for 2; > 1, 

[1 - z-T"' z-^ (In z) ^ ap{z- l)^'^ (In z) ^ 



r{z) = h{a (In;^)'') 



(T [1 - (1 - 2;-!)"] a [z°' -{z- 1)°] 

Thus, taking logarithm both sides, we have 

Inr(^) = In ^ + (a - 1) ln(^ - 1) + In In ^ - ln[^'^ - {z - 1)"]. 

a 13 

Taking derivative, we obtain 

r\z) _ a-l^^-l 1 q;(z"-^ - (z - 1)"-^) 



r{z) z-l j3 zlnz 2;° - (z - 1)° 

/3{a - l)z\n z + {/3 - l){z - 1) a{z'^-^ - (z - l)""^ 
~ ^2^(2; - 1) In 2; z'^-{z-lY 

pzhiz [{z - 1)" + {a- z)z''-^] + {P-l){z- 1) [z" -{z- 1)"] 
~ l3z{z - 1) In 2; [z<^ -{z- 1)°'] 

siz) 



/3z{z- l)\n z[z" - {z- 1)"] 

Hence the sign of r'{z) is the same as the sign of s{z) since r{z) > and (3z{z — 
l)lnz[z°-(z-l)"] >0. 

Figure 2 shows the graphs of s{z) for parameters in the four regions. From the left panel, 
one observes that s{z) takes pure positive and pure negative values in region I and region 
II, respectively, which implies that the hazard function is monotone increasing in region I 
and monotone decreasing in region II. From the right panel, one observes that s{z) takes 
positive values first then drop to negative values in region III, which indicates the unimodal 
property of the hazard function. In region IV, it is shown that s{z) takes negative values 
first then positive values indicating bath-tub shaped of the hazard function. Furthermore, 
one notices that in region IV, the function s{z) may be positive or negative for all z for some 
of the parameters (a,/?). Overall, the shape of the hazard function is independent of the 
scale parameter. 
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Figure 2: The graphs of s{z) for the four defined regions. Region l={{a, (3) : f3 > 1 and af3 > 
1}, region 11= {{a, (3) : (3 < 1 and a/3 < 1}, region lll={{a, (3) : (3 < 1 and a/3 < 1} and 
region IV={(a,/3) : /3 > 1 and a/3 < 1}, respectively. 
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3 Maximum likelihood estimator under type II censor- 
ing 

Let Xi, ...,Xn be the lifetimes of the n independent components under testing. With type II 
censoring scheme, one observes the first r order statistics, < X2:n < • • • < Xr-.n, of the 
sample xi, Xn- Based on the censored data xi:n, Xr-.n, the likelihood function is 



n fi^i-n, ^) [1 - F{Xr:n] 0)]^ , Xi;n < X2:n < 



{n-r)\ fj^ 

The maximum likelihood estimator of 9 satisfies the following score equations: 
d 



de 



where fj{x; 9) = {^x; 9), f'^{x; 9), /^(x; 9)f and f^F{x; 9) = (F^(x; 9), F'^{x; 9), F'^{x; 9))^. 
After some algebraic manipulations, we have 



fix; 9) 

1-F{x; 9) 
nix; 9) 



a 



[l + lnF(a;;^)], 



1 F{x;9) lnF(a;; 
a 1-F{x;9) 
1 



f{x;9) 



l-F[x; 9) 
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fix; 9) 

F'Ax\ 0) 
l-F{x;9) 



1 



1 + l0£ 



x\^ {a-\)xf{x;9) 
a) ^ aPF{x; 9) 



1 (xY xf{x;9) 



a 



Fix; 



^_.xY ^{a-l)xf{x;9) 



a/3F(x; 



1 xf{x;9) 
al-F{x;9)' 



(2) 
(3) 
(4) 
(5) 
(6) 
(7) 



Notice that if {xi} is a random sample from EWD with parameter vector 9, then {t/j = } is 
a random sample from exponentiated exponential distributed (EED) with shape parameter 
a and scale parameter A = cr^. Since /3 > 0, Xi^n < X2;n < ■ • • < Xr-.n is equivalent to 
yi:n < y2:n < ' ' ' < Vr-.n, the first T ordcr statistics of t/i, • ■ ■ , y„. 

Hence we propose the following back fitting algorithm to obtain the MLE of 9: 

Step 1. For a given initial value of /3, maximize L{a, /3^^\ a) with respect to (a, cr)^ e R\. 
Denote the maximizer by {a^^\ a^^^)^. 

Step 2. Substitute a = a^^\a = a^-^'' into L(a,f3,a) to get profile likelihood function Li{f3). 
Maximize Li[f3) over to obtain f3^^\ 



Step 3. Repeat Steps 1 and 2 A; times to get 9^''^ = (q;W, ^('^^ crW)^. 
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Step 4. Stop if ||6"^'^) — ^(^'^^)|| < e for a pre-chosen small e > 0. 

THEOREM 3.1 The limit of the back fitting estimator is the MLE. That is, 

max max /3, cr) = max L(^). (8) 

Proof: Denote the MLE of d by Omle = {o^mle^ I^mle^^mleY^ and the estimator ob- 
tained by back fitting algorithm by 9bf- 

It is clear that the right hand side of the equation ^ is bigger than or equal to the left 
hand side. For the other direction, one notices by definition that 

max L(6') = L{9mle) < max L{a,(3MLE,(^) 

= L{aBF, I3mle,o'bf) < L{aBF, I^bf-,cfbf) 
= max max L(a,B,a). 

This completes the proof. 

Hence for a given /3 > 0, the problem is equivalent to find the MLE for EED with type II 
censored data yi-n = a;^.„, ■ ■ ■ , t/r-.n = x^.n- Iii fact, the MLE of the EED parameters satisfies 
the following fix point equation 

(a. A) = r5((a. A), (9) 
where g{a^ A) = {gi^{a, \),g2{(y, A) and 



= (n-r)^ Eln(l-e--/^) 

^2(a,A) = 



r 



1 - (1 - e-y-:^l^) 



To solve equation ([H]), one can choose an initial value and A'^''^ for a and A, respectively. 
Substitute and A*^*^^ into the right hand side of the equation ([9]) to get a^^^ and \'^^\ Con- 
tinue this procedure k times to get a*-'^^ = rgi^{a^^~^\ cr^'^"^)) and cr*-'^^ = rg2^{a'^'^~^\ X^^'^"^) 
for k = 0,1,.... The iteration stops when \\{a^''\ X^''^) — {a^''~^\ X^''^^^)]] < e, a given pre- 
selected small positive number such as 10^^. For given /3, the estimator of (a. A) is denoted 
by (d. A), hence the estimator of a is a function of /3, denoted by (3"(/3) = y^^. Plug in the 
a and into the log-likelihood function to obtain the profile likelihood function Li{(5) 
in 13. Maximizing Li{l3) to obtain /3 and hence to obtain the maximum likelihood estimator 
^ = (d,/3,af = (d,/3,a(/3)f. 
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4 Fisher information matrix 



Now we assume that r /n p & (0, 1) as n — )■ oo. Notice that the hazard function h{x\ 9) = 
f{x,6)/{l — F{x;6)). Denote the Fisher information matrix based on the first r order 
statistics by lp{0) and let Xp be the lOOp percentile of F{x; 6) such that F{Xp] 6) = p. 

Lemma 4.1 (Zheng, 2001) Assume F{x;9) has the same support for any 9 E Q, an open 
set in . For x E R and 9 E Q, assume 



-F[x- 



dxd9 

where all derivatives exist. Furthermore, under the interchangeability property for orders of 
limits, derivative and integral, the limiting Fisher information matrix can be expressed as a 
single integral of hazard function under type II censoring. That is, 

1 T 



d 

— log h{x; 9) 



^ log Ma;; 



/(x; 9) dx. 



Consequently, the asymptotic covariance matrix of the maximum likelihood estimator of 9 
based on the first r order statistics is Ip^{9). 



Notice that 



— log h{x] 9) = + J-,, 

o9 f{x;9) l — F{x; 



Thus, for EWD family, the equations 



imply that 



d 

— In h(x; 9) 
da 



1 + 



\nh{x]9) 



d_ 
d 

— In h(x; 9) 
da 



1 
a 
1 



In F(x: 



1 + ln 



1-F{x;9) 

x\^ 
a 



1 



X \ ^ ^ (a — 9) ^ 



xf{x\ 9) 



x\^ ^ {a-\)xf{x-9) ^ 



G 



a/3F{x;9) I3{1 - F{x;9)) 
xf{x;9) 1 



al3F{x;9) l3{l - F{x;9)) j ' 
Denote the Fisher information matrix based on the first r order statistics by 

m = [Pp'ie) 

Let 

ij{z;a) = 1 + ln(l - z) 



(10) 

(11) 
(12) 

(13) 



l,2,3;j = l,2,3. 
1- z 



1 



a 



1 - z'^ 



Notice that il){z]l) = 1. Then, we have our main theorem. 



THEOREM 4.1 Let r/n p = F{\p; 9) G (0, 1). For EWD family with parameter vector 
9 = {a,/3,a)'^ under type II censoring, we have 

2 



IpiO) 





In X 


-J' 


1 + 1 


Jo 


1 — X 



dx. 



(14) 
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r33/ 



r23/ 



— J i^l + \n[-\n{l-x)]ip{x;a)j x""-^ dx, 



a 



2 



cr / JO 



(x; a)x°' dx 



(15) 
(16) 



If (^) = ^ (^ + 13^) {l + ln[-ln(l-a;)]^(a;;a)|a;"-^ dx, (17) 



a/3 /-P 



l/a 



1 Inx 

+ 



a Jo \a \ — x^ 



ip{x;a)x"' dx 



a Jo 



{1 + ln[— ln(l — x)]'i{j{x; a)} 'ijj{x; a)x^ ^ dx. 
Proof: By Lemma [4. H equations ffTTl) and F{Xp; 6) = p, we have 

Il\e) = [ / —\nh{x;e) dF{x-e) 



(18) 
(19) 







\p 1 

a 

1 fP 



Jo 



1 + 



1-F(x; 
Inx ^ 



1 — X 



dx. 



which completes the proof of equation ( fT4l) . To proof ( |T5l) . we introduce new variable by 
change of variables using 1 — e'V'^'' = z. Then F {x; 6) = z°' , i^j = —\n{l—z), f{x;9)dx = 
cxz^~^ dz 

xf{x;9) {l~z)ln{l-z) 



af3F{x; 6) 

xfjx; 6) 
/3(1-F(x;^)) ' 



az^-^l - z) ln(l - z) 



1 - z° 



and 



1 - 



X 



a 



^ {a — l)xf{x;9) xf{x; 



+ 



+ 



al3F{x;e) /3(1-F(x;^)) 



ij{z;a) 



(20) 
(21) 

(22) 



Equations (fT2!) and (122|) imply that 



5^ 



\nh{x]e) 



dF{x]^ 



a fP 



/32 Jo 



l/a 



[1 + ln(- ln(l - x))i){x] a)]^ x"-^ rfx 



which completes the proof of f[T5|) . Similarly, direct algebraic manipulations lead the other 
equations ffT6l) -(fT9D. 

Using integration and Taylor series expansion methods, one can verify that EWD satisfies 
the regularity conditions (Bhattacharyya, 1985). Hence we have the asymptotic normality 
theorem. 
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THEOREM 4.2 Let r/n p = F{\p; 0) e (0, 1). For EWD family with parameter vector 
9 = {a, /3, 0")"^ G under type II censoring, we have 

{Omle -O)^ Ns{0, l;\e)), asn^oo. 

5 Real data analysis: two examples 

In this section, we use maximum likelihood method to fit two real data sets. One is the 
ball bearings lifetime analyzed in Gupta and Kundu (2001) and the other is the breaking 
stress of carbon fibres (in Gba) from Nichols and Padgett (2006). For the first data set, 
Caroni (2002) has pointed out that the data set contains censored points. For the second 
data, it will be interesting to see how the censoring rate affect the estimation. We consider 
three censoring rates of no censoring, 10% censoring and 20% censoring. The ball bearings 
lifetime data set contains 23 observations, while the breaking stress of carbon fibres data 
contains 100 observations. We fit the data sets using both the exponentiated exponential 
distribution (EED) and the exponentiated WeibuU distribution (EWD). For the maximum 
likelihood estimates of EED, a modified quasi-Newton method with box constraints in the 
function optim() in R package is used. The maximum likelihood estimates are presented in 
Table 1. Note that EED{a,a) = EWD{a, l,a). 



Table 1: Maximum likelihood estimates of the model parameters 
for ball bearings lifetime 







Censoring rate 


Distribution 


Estimate 


0% 


10% 


20% 


EED 


a 
a 

-log(likelihood) 


5.2707 
31.0035 
112.9762 


5.0752 
31.7540 
104.6143 


5.0728 
31.7592 
91.0536 


EWD 


a 

/3 
cr 

-log(likelihood) 


4.7446 
1.0444 
33.6008 
112.9740 


7.7412 
0.8462 
22.3618 
104.5917 


9.0634 
0.7924 
19.3368 
91.0128 



The maximum likelihood estimator is robust against various censoring rates for EED. 
On the other hand it is sensitive for EWD. The standard likelihood ratio test shows that 
the shape parameter /3 in EWD is not significant different from one, hence the EED is suit- 
able in modeling the ball bearings lifetime. The result is consistent with Gupta and Kundu 
(2001) for no censoring data. This property still holds under various censoring data. As an 
illustration, with 10% censoring rate, the log-likelihood function and its contour plot is given 
in Figure [5l 
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Figure 3: The log-likelihood function and its contour plot of EED under 10% censoring rate 
for ball bearings lifetime data. 



Table 2: Maximum likelihood estimates of the model parameters 
for break stress data 







Censoring rate 


Distribution 


Estimate 


0% 


10% 


20% 


EED 


a 
a 

-log(likelihood) 


7.7883 
0.9870 
146.1823 


7.6053 
.9994 
137.4110 


6.9949 
1.0487 
130.8363 


EWD 


a 
a 

-log(likelihood) 


1.3169 
2.4091 
2.6824 
141.3320 


.4432 
5.5320 
3.4164 
130.5830 


.1840 
12.4404 
3.6032 
125.6935 



Once again, the maximum likelihood estimator is robust against various censoring rates 
for EED. On the other hand it is sensitive for EWD. The shape parameter /3 in EWD is 
significant different from one by the standard likelihood ratio test. Hence it is better to use 
EWD in modeling the break stress. The result is consistent with Nichols and Padgett (2006). 
The EWD fit still holds for censored data. As an illustration, with 10% censoring rate, the 
log-likelihood function and its contour plot is given in Figure [51 



n 



1 1 1 

5 10 15 20 

Figure 4: The log-likelihood function and its contour plot of EED under 10% censoring rate 
for the break stress data. 

6 Conclusion 

For data generated from exponentiated WeibuU distribution, we visualize the shape of the 
hazard function under various shape and scale parameters. Under type II censoring, we 
propose a simple algorithm for computing the maximum likelihood estimator and derive the 
Fisher information matrix. The latter one is represented through a single integral in terms 
of hazard function, hence it solves the problem of computation difficulty in constructing 
inference for the maximum likelihood estimator. Data analysis for two real data sets shows 
that the maximum likelihood estimator is robust with respect to the censoring when the 
underlying distribution is the exponentiated exponential, but not for general exponentiated 
WeibuU distribution when the shape parameter (3^1. 
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